Switcher-random-walks: a cognitive-inspired mechanism for network exploration 
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□ 

Semantic memory is the subsystem of human memory that stores knowledge of concepts or mean- 
ings, as opposed to life specific experiences. The organization of concepts within semantic memory 
can be understood as a semantic network, where the concepts (nodes) are associated (linked) to 
others depending on perceptions, similarities, etc. Lexical access is the complementary part of this 
system and allows the retrieval of such organized knowledge. While conceptual information is stored 
under certain underlying organization (and thus gives rise to a specific topology), it is crucial to 
have an accurate access to any of the information units, e.g. the concepts, for efficiently retriev- 
ing semantic information for real-time needings. An example of an information retrieval process 
occurs in verbal fluency tasks, and it is known to involve two different mechanisms: 'clustering', 
or generating words within a subcategory, and, when a subcategory is exhausted, 'switching' to 
a new subcategory. We extended this approach to random-walking on a network (clustering) in 
combination to jumping (switching) to any node with certain probability and derived its analytical 
expression based on Markov chains. Results show that this dual mechanism contributes to optimize 
the exploration of different network models in terms of the mean first passage time. Additionally, 
this cognitive inspired dual mechanism opens a new framework to better understand and evaluate 
exploration, propagation and transport phenomena in other complex systems where switching-like 
phenomena are feasible. 

Keywords: random-walks; complex-networks; information retrieval; cognitive systems; switching- 
clustering; 



INTRODUCTION 



Semantic memory is a distinct part of the declara- 



tive memory system |Tulving 1978 comprising knowl- 
edge of facts, vocabulary, a nd concepts acquired through 
everyday life Squire 1987 . Contrary to episodic mem- 



ory, which stores life experiences, semantic memory is 
not linked to any particular time or place. In a more 
restricted definition, it is responsible for the storage of 
semantic categories and naming of natural and artifi- 

It is known that 



Budson & Price 


2005 


involves distinct 


jrain 



Drain regions and its im- 
pairment in neurodegenerative diseases such as fronto- 



temporal dementia Libon, Xie, Moore, Farmer, Antani, 



McCawley, Cross, & Grossman 2007 , multiple sclerosis 
Henry & Beatty 2006 and Alzheimer's disease [Rogers &J 



riedman||2008] produce verbal fluency deficits. For this 
reason, lexical access, the cognitive information-retrieval 
process in charge of retrieving concepts, has been widely 
explored through semantic verbal fluency tasks in the 



context of neuropsychological evaluation Lezak 19951. 
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These tests require the generation of words correspond- 
ing to a specific semantic category, typically animals, 
fruits or tools, for a given time. Although the task is 
easy to explain, it actually results in a complex challenge 
where retrieving as many concepts as possible in a limited 
time depends more on cognitive mechanisms than on the 
knowledge itself. According to the two-component model 
propo sed by A. Troyer [Troyer, Moscovitch, fe Winocur| 
1997 , optimal fluency performance involves a balance be- 



tween two different processes: 'clustering', or generating 
words within a subcategory, and, when a subcategory is 
exhausted, 'switching' to a new subcategory. In the case 
of naming animals, clustering produces semantically re- 
lated transitions (e.g. lion-tiger) and switching is a mech- 
anism that allows to jump or shift to different semantic 
fields (e.g. tiger-shark). While the former is attached 
to the temporal lobe of the brain, the latter has been 
associated to a frontal lobe activity Troyer, Moscovitch, 



Winocur, Alexander, & Stuss 2002" Evidences of the 
interaction between these two regions of the brain dur 
ing language related tasks has led a number of studies 
to refer to a fronto-temporal modulation or interaction 
Poldrack, Wagner, Prull, Desmond, Glover, & Gabrieli 



1999 



2002 



Troyer, Moscovitch, Winocur, Alexander, fc Stuss 



In this paper, the cognitive paradigm that consists 
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RANDOM 



FIG. 1: Switcher random walks: transitions between nodes in a 
graph can occur through random movements following the edges 
(black arrows) but also through switches (red arrows). Switching 
allows a more efficient exploration, since clustered graphs might 
difficult finding rare paths between sub-graphs. Isolated modules in 
particular (circle) would be seldom reached and rarely abandoned 
through random walking. 



of retrieving words from a semantic network [Rogers 


& Friedman 


2008 


Thornton, Raz, & Tucke 


20021 was 



generalized to an exploration task on a network. Clus- 
tering was modeled as a random-walker constrained to 
the topology of the network and switching as an extra- 
topological mechanism that is able to move from any 
node to any node (see figure [2j. The combination of these 
two processes gave rise to a dual mechanism denoted here 
as switcher-random-walker (SRW), i.e. a random- walker 
with the additional ability of switching. The combination 
of switching and clustering, i.e., free jumping and random 
walking, was ruled by a parameter q, which is the proba- 
bility of switching at every step, and thus is the parame- 
ter that metaphorically rules the fronto-temporal modu- 
lation. Therefore the complementary (1 — q) is the prob- 
ability of clustering at every step, and can be interpreted 
as the strength of the local perseverance of the explo- 
ration before moving somewhere else within the network 
(specially for those networks with either high clustering 
coefficient or high modularity). This cognitive inspired 
paradigm gives rise to the following question: how does 
switching and its modulation affect random exploration 
of different network models? 

Search, propagation and transport phenomena have 



been studied in networks Bollt & Ben-Avraham 2005 



where it is crucial to define whether the full topology is 
known. When it is known, the ease to reach any node 
from any node is measured by the shortest path length 
B.Tadic & Rodgers|2002||Watts & Strogatz|1998l. When 



it remains unknown, exploration is modeled by random 
walks along the network Noh fc Rieger|2004 . This is the 
case of retrieving concepts since the subject is not aware 



of his full semantic network when naming them. In this 
kind of cases reachability of nodes is measured with the 
mean first passage time (MFPT), i.e. the averaged num- 
ber of steps needed to visit a node j for the first time, 
starting from a node i iCatral, Neumann, & Xu 2005 



Snell 1959 . Given its relevance in complex media, this 



paradigm has been recently revisited in a number of stud- 



ies Catral, Neumann, & Xu||2005 


Condamin, Benichou, 


Tejedor, Voituriez, & Klafter||2007 


Noh & Rieger||2004 . 


While different derivations of 
been recently used to infer the 
cal properties of complex network 


random-walkers have 
underlying topologi- 


3 da Fontoura Costa 



7z Traviesol 120071 IGomez-Gardcncs & Latora 2008 



Ramezanpour 2007 , our aim was to evaluate how SRW 
(and in particular, the effect of different levels of switch- 
ing) contributes to the exploration of network models 
with well known topological properties. Different mod- 
els which were not necessarily lexico-conceptual architec- 
tures were explored by a SRW and its performance was 
measured by the MFPT (detailed in section II C). Go- 
ing back to the cognitive paradigm, retrieving plenty of 
words in a semantic verbal fluency test not only depends 
on the number of concepts that the subject knows, but 
also on an equilibrium between the underlying semantic 
topology that organizes those concepts and the frequency 
of switching |Troyer, Moscovitch, fc Winocur||1997|. For 
example, two different studies Boringa, Lazeron, Reul- 



ing, Ader, Pfennings, 


Lindeboom, de Sonne villc, Kalk- 


ers, & Polman 1982 


Sepulcre, Vanotti, & et al. 


2006 



reported that their respective groups of healthy partici- 
pants produced 30.7±7.9 and 28.15±7.32 animals during 
90 seconds. There are two remarkable aspects in these 
figures. First, participants obviously knew many more 
animals than those said and, second, there is a high het- 
erogeneity in the number of words. Hence, even though 
all participants only named a low fraction of the animals 
they knew, some of them had much more success than 
others when retrieving them. 



II. A MARKOV MODEL OF SRW 



As introduced in the previous section, our approach 
for a clustering step consists of a walker unaware of the 
full network moving from one node to any of its neighbors 
with no preferential gradients among neighbors. Such ex- 
ploration task was modeled by the well known random- 
walker (RW). Switching was implemented as a mecha- 
nism where the walker moves to any other node following 
different probabilistic approaches. Summarizing SRW 
can be defined as a random- walker with the capability 
of rendering random shifts. 
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A. Markov Chains 

A finite Markov chain is a special type of stochastic 
process which can be described as follows. Let 



S = {si, 



-} 



(1) 



be a finite set whose members are the states of the sys- 
tem, which we label s l5 s r . The process moves through 
these states in a sequence of steps. If at any time it is 
in state i, it moves to a state j on the next step with 
some probability, II : S x S — > MsxSi where M. 

SxS is 

the set of S X S matrices of non-negative entries where 
the sum of every row is 1. These probabilities define a 
square, r x r matrix, II: 



n = [pij], 



(2) 



which we call the matrix of transition probabilities. The 
importance of matrix theory to Markov chains comes 
from the fact that the ijth entry of the nth power of 
LT, LT™ = [p^] represents the probability that the pro- 
cess will be in state j after n steps considering that it 
was started in state i. The study of a general Markov 
chain can be reduced to the study of two special types 
of chains. These are absorbing chains and ergodic chains 
(also known as irreducible). The former contain at least 
one absorbing state, i.e. a state constituted by a proper 
subset of the whole by which, once entered it cannot be 
left, and furthermore, which is reachable from every state 
in a finite number of steps. The latter are those chains 
where is possible to go from any state to any other state 
in a finite number of steps and are called regular chains 
when 

(3n < oo) : (Wi,j < r)(\/N > f»)(p$° > 0). 

For regular chains, the ijth entry of LT" becomes essen- 
tially independent of state i as n is larger. In the case 
of regular chains, we can define a stationary probability 
Sne!I|[T959] n°° as: 



matrix 



lim ir = n°°. 



(3) 



Note that for non regular Markov processes this limit 
might not exist. For instance II = (° J). 

The matrix H°° consists of a row probability vector w 
which is repeated on each row. This vector w can be ob- 
tained as the only probability vector satisfying w = wH 
Grinstead fc Snell|1952 . For the case of regular Markov 



processes obtained from random walks on graphs, this 
indicates that in the long run, the probability to be in 
a node is independent of the node where the process 
started. 



B. Graph Characterization 

This section is devoted to the characterization of the 
underlying object over which we apply our algorithm of 



exploration, a graph. Beyond its main features, we dis- 
cuss the consequences of connectedness in order to clearly 
define the frameworks over which the SRW algorithm can 
be defined. Finally, we briefly define the graph models 
studied numerically in section [TTT] 

Let us suppose that our Markov chain is defined by 
some graph topology. A graph Q is defined by a set 
of nodes, V = {v±, v n }, and a set of links T = 
{{vi, Vj}, {vk, vi}}, being T a subset of V x V. In our 
approach, the graph is undirected and we avoid the pos- 
sibility that a node contains auto-loops or that two links 
are connecting the same nodes. The size of the graph is 
\V\, i.e. the cardinal of the set of vertices. Its average 
connectivity is defined as: 



2|r| 
\v\ 



(4) 



The topology of our graph is completely described by a 
symmetrical, |V| x \V\ matrix, A{Q) = [a^], the so-called 
adjacency matrix, whose elements are defined as: 



1 <-> {vi,Vj} e r 
otherwise. 



(5) 



The connectivity of the node Vi, k(v{) is the number of 
links departing from vi and it can be easily computed 
from the adjacency matrix as: 



k(vi 



E ■ 

i<|v| 



(6) 



Following the characterization, we now define the degree 
distribution, which is understood as the probability that 
a randomly chosen node displays a given connectivity. 
In this way, we define the elements of such a probability 
distribution, {p} as: 



Pi 



\{.v j €V):(k(v j )=i)\ 

\v\ 



(7) 



The above defined measures are the identity card of a 
given graph Q. One could think that it is enough be- 
cause our main goal is to describe and characterize an 
exploration algorithm over Q . However, specially in the 
models of random graphs, we cannot be directly sure that 
our adjacency matrix defines a fully connected graph, i.e, 
that there exists, with probability 1 a path from any node 
Vi to any node Vj. In deterministic graphs, we can solve 
this problem by assuming, a priori, that our combina- 
torial object is fully connected. Furthermore, we could 
agree that, when performing rewirings at random, we 
impose the condition of connectedness. The case of pure 
random graphs is a bit more complicated. Indeed, a ran- 
dom graph is obtai ned by a stochas tic process of addition 
or removal of links Bollobas|2001 . Thus, we need a cri- 
teria to ensure that our graph is connected or, at least, 
to work over the most representative component of the 
obtained object. Full connectedness is hard to ensure in 
a pure random graph. Instead, what we can find is a 
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FIG. 2: Visualization of small examples (|V| = 100) of the four network models analyzed here: (A) Small-world network. (B) Random 
Erdos-Renyi network. (C) Random-modular network: here a network is partitioned into 10 modules, each one connecting to each other 
with a large probability, whereas a very small inter-module probability is used. (D) Scale-free network obtained by means of preferential 
attachment. See section [II B| for a detailed description of each network model 



giant connected component, GCC . Informally speaking, 
we can imagine an algorithm spreading at random links 
among a set of predefined nodes, the so-called Erdos- 
Renyi graph process. The growing graph displays, at the 
beginning, a myriad of small clusters of a few nodes and, 
when we overcome some threshold in the number of links 
we spread at random, a component much bigger than the 
others emerges, i.e. the GCC Erdos & Renyi 1960 . In 
this way, M. Molloy and B. Reed |Molloy fc Reed||1995 
demonstrated that, given a random graph with degree 
distribution {p}, if 



J2Hk-2) Pk >0 



(8) 



then, there exists, with high probability, a giant con- 
nected component. The first condition we need to as- 
sume is thus, that the studied graphs satisfy inequality 
Beyond this assumption, we impose the following 
criteria when studying our model networks: 

1. In a deterministic graph (for example, a chain or 



a lattice) where we perform random re-wirings, we 
do not allow re- wirings that break the graph. 

2. If a graph is the result of an stochastic process, the 
exploration algorithm is defined only over the GCC 
(this could imply the whole set of nodes) . 

3. The adjacency matrix is the adjacency matrix of 
the GCC. We remove the nodes that, in the begin- 
ning, participated in the process of construction of 
G but fell outside the GCC. 

All the model graphs studied in this work satisfy the 
above conditions. 

In order to enable useful comparative analysis, we built 
different networks, all of them with \V\ = 500 nodes and 
|r| = 2000 links. The results were averaged after 100 
instances per network model. Let us briefly define the 
models we will study with our exploration algorithm. 

Watts-Strogatz Small- World Network. We built 
an annulus with 500 nodes in such a way that every 
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node is connected to 8 different nodes (2000 undirected 
links) [Watts & Strogatz 1998] . Once the annulus was 



constructed, every link suffered a random re-wiring with 
connectivity p = 0.05. 

Erdos Renyi Graph. Over a set fo 500 nodes we 
spread at random 2000 links, avoiding duplication and 
self-interaction, ft can be shown that the obtained graph 
displa yed a binomial degree distribution |Erdos fc Renyi| 



1960 



p k =^ vl ~ i y k ii-*r i - k - 1 , 



(9) 



being it the probability of two nodes being connected. Its 
value corresponds to 



T=|r| 



(10) 



Random-Modular. We built 10 different compo- 
nents of 50 nodes and 200 links, spread at random (as 
explained for Erdos Renyi graphs) among the 50 nodes 
of every component. In this case, we ensure connected- 
ness of such components. Once the ten components are 
constructed, every link suffers a random rewiring with a 
node either from the same component or not, with prob- 
ability p = 0.05. 

Preferential Attachment. We provide a seed of 9 
connected nodes. Every new node was connected to 8 of 
the existing nodes with probability proportional to the 
connectivity of the existing nodes, i.e., suppose that, at 
time t a new node Vi comes in to the graph. At this time 
step, the graph will display an adjacency matrix A(t). 



P(ay(t) = l) = 



k(Vj)(t-l) 



where 



At = {(v k : 31) : (a w (t) > 0)} 



(11) 



(12) 



This operation is repeated in an iterative fashion (i.e., 
updating A) 8 times per node. It can be shown that, at 
the limit of a large number of nodes the outcome of this 
algorithm ge nerates a graph whose de gree distribution is 
a power law [Barabasi fc Albert|1999[ : 



Pk oc 



(13) 



with a = 3. It is worth noting that such an algorithm 
avoids the possibility of unconnected components. 



C. Random walk over a graph as a Markov Process 

In this framework, the transition from node i to j is 
just the probability that a random-walker starts from 
some node i and reaches the node j, after some steps. 



Consistently, the probability that being in vi we reach 
the node Vj in a single step (i.e, pij) is: 



Pij 



k(vi) 



(14) 



This is the general form for a Markov formalization of a 
random-walker within a graph defined by its adjacency 
matrix A. Throughout this work we assume that our 
graphs define regular Markov processes (see section II A I. 
Under the above definition of II, regularity is assured if 
and only if the graph is not bipartite (i.e., it contains, at 
least, one loop containing an odd number of nodes). To 
see that bipartite graphs are not regular, it is enough to 
notice that for any pair of nodes (Vi,Vj) there are only 
either odd or even paths joining them, but not both. 
Hence if j>y ^ then Py — and therefore the 
process cannot be regular. 

Summarizing, despite that connectedness ensures that 
the process is ergodic, 

it does not ensure regularity and therefore the 
linin—too IT™ might not exist. The existence of an odd loop 
breaks such parity problem and enables II™ to stabilize to 
a specific matrix of stationary probabilities when n — > oo. 
Thus, we must impose another assumption to our studied 
graphs: Our algorithm works over non-bipartite graphs 
which satisfy the criteria imposed in section II B. It is 
straightforward to observe that, if the assumption of reg- 
ularity holds, the above Markov process has a station- 
ary state with associated probabilities proportional to the 
connectivity of the studied node |Noh fc Ricgcr 2 004] : 



P 



(oo) 



k(vj) 
2|ri ' 



(15) 



From now on, we will refer to the transition matrix above 
defined as IP', since it denotes the probabilities of the 
movements related to clustering. 



D. Switcher- random- walker 

In the retrieval model introduced here, the matrix of 
transition probabilities H srw is a linear combination of 
the switching transition probabilities IP*" and the clus- 
tering transition probabilities H cl , as defined in the above 
section. The Markov process is a switcher-random-walker 
and the states represent the location of such walker in the 
network. 

The matrix H sw = [pfj"] is ergodic and regular since all 
entries are strictly greater than zero, and has equal rows, 
i.e. constant columns. The reason is that the probability 
of reaching a node j through switching is independent of 
the source node i. In this way, we could consider that we 
define a scalar field A over the nodes of the graph: 



Pi 



A, 



(16) 
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Consistently, 



E X 3 



(17) 



J<|V| 



We can define this field in many different ways. As the 
more representative, we revise several scalar fields that 
can provide us interesting information about the process: 



k(vj 



E k ^ 

i<\V\ 



(18) 



K - k(vj) + 1 

E *m 

i<\V\ 



In the first and most simple case switching to any other 
node is a random uniform process, and we refer to this 
process as uniformly distributed switching. The second 
case corresponds to the situation where the probabil- 
ity to reach a given node through switching is propor- 
tional to its connectivity, which we call positive degree 
gradient switching. The last one assumes that K is 
max{/c(t; i )} and corresponds to the situation where the 
switcher jumps with more probability to weakly con- 
nected nodes, and we refer to it as negative degree gra- 
dient switching. These three variants of switching were 
studied when combined with a random- walker within the 
above graph topologies (see fig.([3|). They were denoted 
by SRW=, SRW+ and SRW~ respectively. 

The matrix IF' = [pfj] defined in the above section 
is ergodic and regular but restricted to the transitions 
allowed by the adjacency matrix A of the network of 
study. We modeled as equi-probable the transitions 
among linked nodes of the network. Hence the proba- 
bility of moving from a node t>, to a a node Vj through 
clustering for a given graph Q with an adjacency matrix 



is 



(19) 



k(vi) ■ 

Thus, IF™ = [pf™] is defined as: 

IF™ = qU sw + (1 - q)U cl {0<q< 1), (20) 

where q is the probability of switching. Consistently, the 
entries of IF™ are given by: 

p!™=qp*y + (l-q)p%, 0<q<l. (21) 

We observed that II s ™ is also ergodic and regular. 
This follows from the fact that II™ has already all entries 
strictly greater than zero, and thus II s ™ will have all 



entries greater than zero for any q > 0. For the case of 
q = 0, IT™ is just IT' which we assumed to be regular. 

Among other interesting descriptive random variables 
that can be evaluated for regular chains, the matrix of the 
mean first passage time (MFPT) is a matrix (T) = [(ty)], 
crucial for measuring the retrieval or exploratory perfor- 
mance of any stochastic strategy; the MFPT needed to 
go from a node i to a node j is denoted by (ty) Noh 



& Rieger 2004 and represents the time (in step units 



required to reach state j for the first time starting from 
state i. It is important to note that (ty) is not neces- 
sarily equal to (tji), i.e. it might happen that the time 
required to go from state i to state j is different to the 
time required to go from state j to state i. 

In order to obtain the analytical expression of MFPT, 
we must define first a fundamental matrix Z Grinstead 



fc Snell|[l952 which is given by 



z = (I - n s 



n°° )" 

srw / 



where 



IF 



lim (IF 



(22) 



(23) 



and I is the identity matrix of size \V\ x \V\. 

In this case the entry #y of Z can be understood as 
a measure of the deviations of the ijth entry of (n s ™)™ 
from their limiting probabilities w, which, as commented 
in section |II A is any of the equal rows of IF^ . From Z 
and w we can obtain the analytical derivation of (T) = 
[(tij)} (f° r more details see jGrinstead fc Snell|[l952] ) : 



(tij) = 



(24) 



Finally, we denote as (MFPT)g the averaged value of 
all entries (tij) for a switcher random walker exploring a 
network Q. Since (T) it is not necessarily symmetrical, 
we must take into account all the entries outside the main 
diagonal. The main diagonal was not taken into account, 
since it represents the returning time, which we do not 
consider as a part of the exploration of the net. Thus, 



(MFPT)g 



1 



EEC*. 



(25) 



This measure provides a general evaluation of how reach- 
able is, on average, any node from any other node in a 
specific network using a switcher random- walker. It is in- 
teresting to notice that such measure has an upper bound 
which is precisely the size of the net. Indeed, let us sup- 
pose we have a clique of size m, i.e., a graph, Q(V,T), 
where \V\ equals m and every node Vi is connected to 
itself and to all to — 1 remaining nodes. It corresponds to 
the case where the probability of switching is 1 . Let X 
be a random variable whose outcomes are Vj such that, 



Vvj e V: 



P(A - Vj) 



1 

TO 



(26) 
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SRW+ 
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a scale-free 
* small-world 
o random 

random-modular 
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FIG. 3: Exploration performance based on the (MFPT)g (see equation |25| l on 4 graph models for the three Markovian variants of SRW 
(se e equation |18| for implementation details of each variant of switching). Parameter q stands for probability of switching (see equation 
201. (A) SRW~ , SRW that contains a uniformly distributed switching. (B) SRW + , SRW that contains a switching with positive degree 
gradient. (C) SRW~ , SRW that contains a switching with negative degree gradient. 



We define a stochastic process, namely, the realizations 
of X through different time steps, X(l), X(2), X(t) 
Let us define another random variable, Y, namely the 
number of realizations of X needed to ensure that there 
has been one realization of X equal to Vj : 

Y = min{X(t) = v j } (27) 

Clearly, and due to the symmetry of our experiment, all 
the nodes behave in the same way. Furthermore, 

(Y) = m (28) 

i.e., we need, in average m realizations of X in order to 
obtain, at least, one realization X — Vj, Vuj E V. We 
observe that the above random experiment is exactly a 
random switching over a graph containing m nodes, and 
that (Y) is the (MFPT) of this process. Let us suppose 
we have a (MFPT) < m. This implies that, in average 

(V» i )P(X = « i )>i (29) 



which is a contradiction, since the graph has m nodes. 
Thus, for a given graph Q(V,T): 

(MFPT)g > \V\. (30) 

This value represents an horizontal asymptote in the 
model of SRW as q increases, and it is clearly defined 
in our model experiments (see figure . 



III. RESULTS AND DISCUSSION 

Our main result was that SRW exploration, a cog- 
nitive inspired strategy that combines random-walking 
with switching for random exploration of networks, de- 
creased the (MFPT) of all models for all SRW variants. 
This means that, on average, the number of steps needed 
to travel between every pair of nodes decreases and thus 
the overall exploration abilities of a SRW within the net- 
works improves respect to RW. 
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Regarding SRW = (Fig. |3}V), exploration performance 
of random-modular and small-world networks severely 
improves, overtaking scale-free at q — 0.1. Moreover, at 
q = 0.3 all the networks but scale-free converged, lead- 
ing to a remarkable scenario where modularity and high 
clustering coefficients are not topological handicaps for 
an efficient information retrieval. 

Switching in SRW + severely improves (MFPT) in 
modular and small-world networks while hardly decreases 
it in scale-free and random. The reason is that a random- 
walker on both kind of networks already shows a gradient 
to visit highly connected nodes Noh & Ricger 2004] , and 
a positive-degree switching supported rather than com- 
pensated this effect due to redundancy on hubs|3j3). 

In SRW~ , intermediate values of q (around 0.6 for all 
but scale-free models) showed optimal performance with 
a similar effect to the one produced by SRW = . However, 
it only partially succeeded in compensating the already 
commented natural RW gradient for hubs. (Fig. |3p). 
Interestingly, those q values close to 1 produced an in- 
verse situation where hubs are so unlikely to be reached 
that the overall exploration performance decreased for all 
the models but dramatically for scale-free model, where 
the degree heterogeneity is specially high. On the con- 
trary, small-world model showed a very similar perfor- 
mance when explored by any of the three SRW variants. 
The reason is that in this model, the degree distribution 
is very homogeneous, and thus different degree gradients 
of switching produced very little differences. 

The approximate convergence of the exploration effi- 
ciency (for most of the topologies when using SRW = or 
SRW~ with a moderate switching rate) allows a system 
to organize information or to evolve without compromis- 
ing exploration and retrieval efficiency. In this sense, 
semantic memory might be organizing information in a 
strongly modular or locally clustered way without com- 
promising retrieval performance of concepts. In a more 
general perspective, the addition of a switching mecha- 
nism and its interaction with random-walker dynamics 
opens a new framework to understand processes related 
to information storage and retrieval. Indeed, switching 
not only mitigates exploration deficits of certain net- 
work topologies but also might provide certain robustness 
to the system. For instance, the rewired links (known 



as short-cuts) in both small-world and random-modular 
models are contributing to facilitate access to different re- 
gions of the network. Those short-cuts might compensate 
a switching impairment or dysfunction and vice versa, i.e. 
switching would ensure an accurate exploration of the 
network even though a targeted attack removed those 
short-cuts permanently. 

Similar mechanisms to switching have been observed in 
the context of information networks. In particular, the 
iterative algorithm PageRank estimates a probability dis- 
tribution used to represent the likelihood that a person 
randomly clicking on links will arrive at any particular 
page for a hyper-linked set of documents (e.g. the world- 
wide-web) |Brin fc Page||1998| . The user is supposed to 
be a random- surfer who begins at a random web page 
and keeps clicking on links but never hitting back. The 
damping-factor is an additional item that includes the 
fact that the user can get bored and start on another 
random page. The combination of these two processes 
is used by the Google Internet search engine to estimate 
the relevance of different links (PageRank values). In- 
terestingly, while the objective (rank link targets) and 
the framework (hyper- linked documents, i.e. directed 
graphs) are not the same, the cognitive-inspired SRW de- 
scribed here and PageRank algorithm combine random- 
walks restricted to a topology with an extra-topological 
mechanism in order to evaluate tasks in complex net- 
works. 

The model proposed here could have implications in 
other systems that usually have a conflict between orga- 
nization and retrieval or spreading efficiency. It will be 
object of further studies in other phenomena unrelated 
to cognitive processes such as infection epidemiology, in- 
formation spreading or energy landscapes. 
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